Introduction to AI Music
My first exposure to the world of AI-Generated music came around a year ago when I watched this video.
Being a fan of both Drake and the Weeknd, it was shocking to me how real they sounded in the video. At first, I thought it was a real song but after reading that it was AI generated I was blown away.
Experimenting with AI Music
One of the first tools I stumbled upon is Suno AI. Immediately you’re greated with examples of AI-generated songs. One of my favorites is titled “Make a song about the moon.”
After seeing a preview of the tool, I decieded to make my own song. I used Gemini to make an R&B song. 
I present,
I decided to test out Suno AI’s custom feature where you can give it a genre and lyrics and it will generate the music. I asked Gemini to generate song lyrics for a Dark R&B song similar to R&B artists Giveon, Brent Faiyaz, and Bryson Tiller.
Here is “Playing with Fire”
How Does It Work?
In order to replicate music, the AI is trained on large data sets of pre-existing music. From this data set it analizes the various patterns, tempos, rythms, and lyrics associated with various genres of music.
Training the Model
Traditionally, when training a model, the model takes the data and makes a numerical vector. In order to allow the model to understand the various aspects that go into creating music, the model is trained with MIDI files that are structured in terms of notes, rhyhtm changes, and beats per minute. This MIDI file can be used to train the model and is considered a “natural language representation.”
The Machine Learning algorithms then use the raw audio data for the entire song in the form of “sequential input vectors” that are commonly used in NLP. The model then is able to predict the next token for the song.
Legal Implications of AI Music
With the rise of AI music, there is also a rise in copyright and licensing issues. As, when someone uses AI to imitate another artist’s music, this can muddy the waters of who owns the music, the creator, the AI, or the artist themself.
Conclusion
Overall, I’m really happy with the result. Even though there are some instances where you can tell that the music is AI-generated, I find it fascinating how accurate and human-like the AI sounds overall. It’s also really impressive to me how the AI can make lyrics on its own based on the genre I tell it. In a future blog post I hope to learn more about how the AI can achieve this and sound like a human while singing.
Sources
https://www.techopedia.com/how-can-an-ai-model-create-music